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Abstract 

In this paper we consider instability of nuclear matter which takes place when 
the frequencies of the collective excitations turn to zero. We investigate collective 
excitations with pion quantum numbers J n = CP . We study the dependence of zero- 
frequency solutions of the pion dispersion equation on the value of the spin-isospin 
quasiparticle interaction G' . The solutions of the pion dispersion equation describe the 
different types of the excitations in the matter, u)i(k). At the critical density p = p c 
one of solutions of the definite type turns to zero: u>io(k c )=0. When p > p c , the 
excitations oJio{k) become amplified. It is shown that there is such a "transitional" 
value of G' = G' tr that for G' < G' tr the zero-frequency solutions belong to the type to sc i 
while for G' > G' tr they pertain to the type u c . The solutions of the type us S( i correspond 
to instability to small density fluctuations of the nuclear matter at G' < —1. On the 
other hand, u c is responsible for the "pion condensation" at G' ~ 2. For the stable 
nuclear matter the branches of solutions uj s d(k) and LO c (k) are located on the unphysical 
sheets of the complex plane of frequency. 



1 Introduction 



In this paper we investigate the excitations of nuclear matter with the pion quantum num- 
bers. Our analysis is based on studies the in-medium pion dispersion equation. Interactions 
of pions with baryons in nuclear matter is included in framework of Migdal model t lJ. So- 
lutions of the pion dispersion equation in this model were considered on the physical sheet 
of the complex plane of pion frequency u. We expand this analysis to the unphysical sheets 
of the Riemann surfaces. We have included first the unphysical sheets to the analysis in 
our earlier papers [21 El- In Ej we studied the branches of solutions responsible for the 
pion condensation and the long wavelength instability and it was shown that they are the 
separate branches supplemented to the well-known zero-sound, pion, and isobar ones. 

In this paper we continue to study the solutions of zero-sound and pion dispersion equa- 
tions responsible for the instability of nuclear matter using the retarded pion propagator. We 
analyze zero-frequency solutions of the pion dispersion equation depending on the value of G 
and define to what type excitations these zero-frequency solutions refer. This could permit 
us to do conclusion about the character of the phase transition related to the considered 
instability. 



Except the purely theoretical interest the problem has various applications. Investigation 
of the pion excitations in nuclear matter, started long ago, continue to play an important 
role in nuclear physics. Special interest in study of the pionic many-body degrees of freedom 
was stimulated by prediction and investigation of the pion condensation [TJ HJ |5J |H| • In recent 
years the study of the pionic many-body degrees of freedom is related to the investigations of 
the excited states and of phase transitions in nuclear matter in heavy ion collisions. Detailed 
knowledge of in-medium pion dynamics is essentially important for description of mesons 
([HE]), nucleons (0) and A-isobars [7j, jH]. Analysis of the dilepton production from n + — n~ 
annihilation requires the knowledge of the pion dispersion in hot and dense matter [8|l9|ll0|. 

To study of the pion dynamics in heavy ion collisions we need the relativistic description 
of the pion self-energy at the finite temperatures. Solutions of the relativistic pion dispersion 
equations were presented in papers fUE]- A pion self-energy with the correct nonrelativistic 
limit was obtained in papers [T3| 114j. 

When considering the pion dynamics in nuclear matter at high densities and tempera- 
tures, it is important to have as a "point of reference" a reliable description of the nuclear 
matter excitations with pion quantum numbers in nonrelativistic limit. Such description 
have been obtained in the pioneering papers of Migdal and his group pQ, followed by the 
numerous papers [2J El E3 EH UH UHj • 

In this paper we study the solutions of the nonrelativistic pion dispersion equations in 
symmetric nuclear matter at zero temperature following to pQ. The aim of this paper is to 
study the solutions with zero frequency u;=0 depending on the value of the coupling constant 
G'. These solutions characterize the stability boundary (in this model it is the boundary 
on the density). In this paper it is shown that at different values of G' the zero- frequency 
solutions belong to the different types of excitations. 

The value of G' is considered in the interval — 1 < G' < 2. When we change G', the 
branches of solutions are changed as well: certain solutions go over from the physical to 
unphysical sheets and vice verse. To identify the solutions on the unphysical sheets it is 
important to know the solutions on the physical ones. The branches of solutions which are 
obtained in the present paper reproduce the results of [TJ [JJJJ |2U| on the physical sheet of 
the complex plane of u. To do comparison with other papers the simple model with the 
constant effective quasiparticle interaction is very useful. However, the pion condensation 
in this model emerges at too low density and this is not consistent with the results of 
investigations, |JJ. 

It is well known that the solutions of the pion dispersion equations, Ui(k), describe the 
different types of excitations in the nuclear matter. They are: spin-isospin zero-sound wave, 
u> s (k), pion wave, uj n (k), isobar wave, u>&(k), and others [TJ [5J El HI] • The appearance of 
the solution with u=0 means that at the certain values of nuclear density p = p c and wave 
vector k = k c the frequency of a definite type of excitations io turns to zero: u>i (k c )=0. 
If p > p c one obtains Imu)i {k) > 0, and the amplified solution takes place. This signals 
the instability of nuclear matter. The change of G' causes the changes of the values of p c 
and k c . Moreover, at a special situation zero-frequency solution passes to another type of 
excitations i\\ cjj 1 (A; c )=0. It was shown in [22] that the phase transition is determined by 
the type of those excitations which become unstable. Thus it is important to know to what 
type of excitations the solutions with lj=0 belongs. 

In Fig. 1 we show the values of critical densities p c and wave vectors k c for which the 



pion dispersion equation 

D' 1 = u?-k 2 -m\ -U R (oo } k) = 0, (1) 

has solutions with u=0 at any value of G' . We are interested in solutions which satisfy 
additional restriction: (-^u(k)) =0. In Eq. (1) n. R (uj,k) is the pion self-energy part 

(retarded polarization operator). The pion self-energy is formed on the basic of particle-hole 
and isobar- hole loops renormalized due to the effective interactions of quasiparticles: G' NN , 
G' NA and G' AA . (The effective constant G' is regarded as G' NN through the paper.) In Fig. 1 
the critical density p c and wave vector k c are presented for three models of the pion self- 
energy. The matter is stable at p < p c for the every model. The physical variables which 
are related to the pion propagator D diverge along the curves in Fig. 1. This corresponds 
to the phase transition [22] in nuclear matter. At p < p c , the nuclear matter is considered 
as a normal Fermi liquid, but at p > p c there is phase transitions into new state which may 
include the standing spin-isospin wave or "condensates of excitation". 

Let us introduce the useful definitions. The waves u s (k), u n (k), wa(^), and others we 
name branches of solutions. The set of branches of solutions of the same type for the different 
values of G' composes a family (u s , uj n , u A , and others). When we say about zero- frequency 
solutions or cu=0 solutions, we mean that the condition (-^to(k)) =0 is satisfied in this 
point, as well. 

Return to Fig. 1. There are known two reasons for instability in the framework of Migdal 
theory pQ in the nonrelativistic symmetric cold nuclear matter at not too high densities. In 
paper j2H| it was shown that Fermi liquid becomes unstable when the attractions between 
the quasiparticles is too strong. In spin-isospin channel this corresponds to G' < —1 pQ. 
In Fig. 1 we see that there are not solutions with u=0 at G' < — 1. This is because of 
the matter is unstable at the any density. Another region of G 1 ~ 2 corresponds to the 
instability in respect to transition into a new ground state containing condensate of pions 
PQ . In the present paper the main attention is paid to study that families of solutions which 
are responsible for instability along the curves in Fig. 1, from long wavelength instability to 
pion condensation. 

We start with the analysis of the zero-sound dispersion equation for spin-isospin excita- 
tions with quantum numbers J n = 0~. This equation is closely related to the pion dispersion 
equation. It was shown in paper [221 121] that for the case of strong attraction between the 
quasiparticles (G' < — 1) the zero-sound dispersion equation has a growing with time solu- 
tion which corresponds to instability in response of small-amplitude, long wavelength density 
fluctuations. For G' > — 1 the unstable solutions do not appear [TTH I2U]. 

In this paper the family of solutions responsible for the long wavelength instability is 
built. We denote this family as u s d- The index "sd" means "spinodal decomposition". It is 
known [221, that the thermodynamic stability condition requires the partial derivative of the 
pressure with respect to the volume to be negative, i.e., (ff?) < 0. The process which takes 
place in matter, when this condition is broken, is known as a spinodal decomposition [2*K] . 
It is shown in [22] , that there is a relation between the effective quasiparticle interaction and 
the partial derivative 

dP_ Npl 

N is the number of particles, F is the effective scalar-isoscalar quasiparticle interaction. 
The stability condition is broken at F < —1. For the zero-sound dispersion equation this 



corresponds to the appearance of the imaginary amplified solutions. It looks reasonable to 
use the notation uj s d{k) for such solutions. Here we use the same notation for the analogous 
solutions, which appear in the spin-isospin channel at G' < —1. Moreover, as it is shown 
below, at G' < all the solutions belong to the same family. We use the notation uj s d{k) for 
them as well. The branches uj s d{k) are imaginary and can be found for all values G' < 0. 

Now we turn to the pion dispersion equation. In the channel of excitations with the 
pion quantum numbers the particle-hole interaction can be modified by taking into account 
the pion-nucleon interactions £Q. As a result, collective and particle-hole excitations are 
renormalized due to interaction with pions and, vice versa, the pion excitations are changed 
due to interaction with particle-hole ones in the nuclear matter. It was predicted PjJ H], 
that the account of the pion-nucleon interaction is responsible for the phase transition into 
the ground state with the pion condensation. In Fig. 1 it is demonstrated that due to the 
pion-nucleon interaction we obtain the phase transition not only for G' < — 1 but for all 
(considered) values of G' . 

For the pion dispersion equation ([TJ we can find the branch of solutions corresponding 
to u s d(k). We denote it as ui^ d {k). The correspondence is established in the following way. 
It will be seen from the form of the pion self-energy that u S d(k) are the poles of II(u;, k), and 
for each value of k the frequency w^ d (k) tends to u> s d(k) as pion-nucleon coupling constant 

fnNN —> 0. 

We show also that there is a special value of G', denoted by G tr (\G' tr \ <C 1). When 
G' < G' tr , the solutions with u=0 are on the branches u^ d (k). When G' > G' tr , the type of 
the family carrying zero- frequency solutions is changed. We shall refer to G' tr as "transition 
value" . 

When G' > G' tr , zero-frequency solutions pass to the branches of solutions of another 
family. It is denoted as u c ("condensate"). The solutions of (1) referred to this family, u c (k), 
are identified in the following way. In papers pQ it was shown that among the solutions of the 
pion dispersion equation the imaginary solutions emerge under special conditions. Instability 
of matter, related to these imaginary solutions is interpreted as a phase transitions into a new 
ground state containing the pion condensate. The branch u c (k) reproduces the imaginary 
solutions presented in [Tj on the physical sheet of uj. It is demonstrated that u c is an 
independent family of solutions along with co n , u s , u>a or u^ d and it is responsible for pion 
condensation. 

In Sect. 2 the expressions for the retarded pion self-energy are presented and the singu- 
larities on the complex plane are investigated. We consider the structure of the Riemann 
surfaces that are defined by the form of the pion self-energy. The unphysical sheets are 
described. 

In Sect. 3 the family uo sd is considered for the zero-sound and pion dispersion equations. 
It is shown how zero-frequency solutions u s d{k c )=0 at p = p c (Fig. 1) come these branches. 

In Sect. 4 the different types of solutions of the pion dispersion equation are considered 
on the physical and unphysical sheets. It is shown that there is an independent family of 
solutions uj c that is related to the pion condensation. 

In Sect. 5 we determine the value of G' tr and show how the solution with u=0 pass from 
the family u}g d (k) to u c (k) when G' = G' tr . 

In this paper we solve the dispersion equations in the symmetric nuclear matter with 



zero temperature. The equilibrium density is po, pi?o=0.268 GeV. During the computations, 
the effective mass of quasiparticles is assumed to be m=0.8m , while m =0.94 GeV is the 
vacuum nucleon mass. The pion mass is m 7r =0.14 GeV, the isobar mass A = 1.23 GeV (the 
isobar width is neglected). Following to the paper [T], the effective nucleon quasiparticle 
interaction can be written as 

^(fci, ax, Ti, k 2 , a 2 , f 2 ) = C (F(ki, k 2 ) + F'(ki, k 2 ){T X T 2 ) + G(k x , k 2 )(aia 2 ) 

+G'(k 1 ,k 2 )(a 1 a 2 )(r l r 2 )), 

where r, a are the Pauli matrices in the isospin and spin spaces. The factor Co = Nq 1 , where 
Nq is a density of states for two sorts of nucleon on the Fermi surfaces, Nq = 2pFm/-n- 2 ; 
F, F', G, G' are the Landau-Migdal dimensionless parameters. In this paper we use a simple 
model where parameters are taken to be a constant: G'(ki,k 2 ) = G'(pf,Pf) = G'. The 
Landau-Migdal parameter G' found from the analysis of the nuclear experimental data is 
G' ~ 1.5 — 1.7 [15, 26J. This parameter describes the short-range correlations between the 
nucleons with a range ~ — : V corr = ^g'(&i(J 2 )(TiT 2 ). The relation G' = -h-^g' sets the 
correspondence of the Landau-Migdal parameters to the effective correlative parameters g' 

mi Hang. 

The Landau-Migdal parameter G' = G' NN corresponds to rescattering of iViV <->■ NN 
quasiparticles. The parameters G' NA and G' AA determine the rescattering of NA «-> A^A" 
and NA <-> NA. The parameters G' NA and G' AA are not changed in the course of paper and 
are taken equal to G' NA =0A and G' AA =1.6 jT]. 

In the paper we take the pion- nucleon coupling constant f n NN = 1 and the pion-nucleon- 
isobar coupling constant f n NA = 2. 

2 The pion self-energy IT (a;, k) 

In this Section we present the expressions for the pion self-energy in nuclear matter. These 
expressions are well known 12H 123 12H] • We do an analytical continuation in u of the 

polarization operator U(uj,k) to the unphysical sheets of the complex plane. The search of 
zero-frequency solutions is related to investigation of the solutions both on the physical and 
unphysical sheets. 

We consider excitations in nuclear matter which are described by the solutions of the 
pion dispersion equation (1). The causality requirement leads to the known interpretation of 
the solutions of the dispersion equation in the complex plane of uo. The stable excitations are 
described by the solutions with real frequencies, placed on the real axis. The damping solu- 
tions (resonances) are placed on the unphysical sheets under the cuts, which the polarization 
operator has on the real axis. This is Landau damping which is related to overlapping of the 
frequency of excitations with the frequency of free particle-hole pairs (which give the imag- 
inary part in the pion self-energy). We can introduce the damping of solutions in another 
way, with the help of the isobar width (taken as the experimental constant, r=115 MeV) 
or quasiparticle damping constant, for example. In this case the real excitations are dis- 
placed to the lower half plane of the physical sheet [21 El • We do not consider this damping 
henceforth. 



At certain conditions (large density, a strong attraction between particles) the imaginary 
solutions arise in the upper half-plane of the physical sheet. They correspond to the ex- 
citations with amplify amplitude. Such excitations correspond to an unstable regime. We 
find the corresponding solutions with negative imaginary part in the lower half-plane of the 
physical sheet, as well. 

The amplified solutions in the spin-isospin channel (as well as all the solutions with 
ReuJi > 0) are interpreted, following [111201, as the frequencies of 7r + -type excitations. While 
the solutions in the lower half-plane (as well as all the solutions with ReuJi < 0) are considered 
as 7r _ -type excitations. Their frequencies have to be taken with an opposite sign in respect to 
the solutions. For the physical excitations of 7r°-type we put into correspondence the solutions 
with ReuJi > 0. In symmetrical nuclear matter with N = Z all three types of solutions, i.e., 
7T + ,7r~,7r° are identical. In the asymmetric nuclear matter the solutions carrying different 
charges are transformed in a different way with the change of the parameter of asymmetry 
and of the density. The method used in this paper permits to follow these transformations 
from symmetric up to neutron nuclear matter. 

Pion self-energy in nuclear matter is due to S- and P-interaction of the pions and nucle- 
ons. The total pion self-energy is thus a sum of a scalar and vector terms: 

n(cj,k) = U s (u,k) + U P {uj,k) . (2) 

The main results of this paper are obtained for H(u,k) = IIp(u;,A;) operator. One can 
consider some models for Tls{u), k) and they give the expressions like iTg = const ■ p without 
u and k dependence |2J EH]- The influence of lis on the final results has the quantitative 
character and is discussed in Appendix A. 



2.1 P-wave part of the pion self-energy, lip (u, k) 

Following the papers [H |2H Ell we write Hp(uj,k) as a sum of the nucleon and isobar parts 

U P (uj,k) = H N (u,k) + U A (u,k) . (3) 

The operators EE n (uj, k) and 11a (w, k) can be expressed through the lowest order polarization 
insertions U° n (uj, k) and IT A (ci;, k) which can be presented as the integrals over the particle- 
hole ($at) and isobar-hole loops ($a)- The vertices of these loops are described by the pion- 
nucleon and isobar- nucleon-pion coupling constants f^NN, fwNA and by the form factors 
which take the nonzero baryon size into account, ds{k ) = A f +k £ , where B = N, A and 
Aat=0.667 GeV, Aa=1.0 GeV. Polarization operators H° n (uj, k), H%(uj, k) can be written as: 

IL N (u, k) = -4(l^)Wd 2 N (k 2 )$ N (uJ, k), (4) 

n A (^ k) = -^(^) 2 fc 2 c4(A; 2 )$A(^ *0- (5) 
Then for 11^, II a we have the expressions 

U N (u,k) = U N (uj,k) 



1 + C (a(fc)G^ A - G' AA )^ A (u, k) 



n A (w, k = n A (a, k) ^ — — . 6 

E{u, k) 

In this equation a{k) = (^f n NAdA(k 2 ))/(2fnNNdN{k 2 )). In Eqs. (JBJ we see that T1n(u, k) is 
II^(u;, fc) with one vertex renormalized due to nucleon-hole and isobar-hole interaction. The 
denominator E(u, k) has a form 

/ 16 
E(u,k) = l + C (4G' NN <Z> N (u,k) + —G' AA <Z> A (uj,k) 

16 \ 
+A-C {G' NN G' AA - G% A )* N (u, k)$ A (uj, k)j (7) 

and the condition 

E(uj,k)=0 (8) 

gives a zero-sound dispersion equation. Solutions of this equation describe the excitations in 
nuclear matter, if we do not take into account the renormalization due to the pion-baryon 
interaction. Equation (1) has the solutions corresponding to the solutions of Eq. (JHJ. Thus at 
G' NN < 0, Eq. (JHJ has the solutions uj s d{k) (which will be shown and discussed below), while 
at G' NN > there are zero-sound solutions u s {k) jTHj 1201 122] • These solutions are the poles 
of Hn(u, k) and H a {uj, k) (JHJ. The equation (1) has the corresponding solutions: oj^ d {k) and 
ujg(k). It can be seen from the structure of Eq. (1) that when f T NN and f n NA approach zero 
points, the branches uj^ d (k) (ujg(k)) approach to the poles of polarization operator U.(u),k), 
i.e., u s (k) {u sd (k)). 



2.2 Extension of U° n (uj, k) in u to the unphysical sheets of the com- 
plex plane 

The causal polarization operator U^(u!,k) can be presented as a sum of two terms, the 
first term corresponds to excitation and the second to the annihilation of the particle-hole 
pairs. We want to study the excitations in nuclear matter which appear as a response on an 
external perturbation and we use the retarded operators in Eq. (1). For the real u they are 
determined as [221 12Z! 

U 0R {u, k) = {Re + i sign{u)Im)U°{uj, k) 
and &n(, u j h) * s expressed through the integrals j2Z] 



(27T) 



d 3 P 



0(\p + k\- Pf)0(pf ~ p) 0(p ~ Pf)0{pf -\p + k\) 



UJ 



2m 



(P+ fc ) 2 _|_ j n 
2m ^ U l 



, £_ _ (p+fc) 2 , • 
W+ 2m 2m ^ l 'l 



2m 



(9) 



The function $jv(^, k) can be written as 

$ n (uj, k) = 4> N (u, k) + 4>n{-u, k). 



(10) 



The first integral in (JHJ corresponds to <p(uj,k) and the second one to <p(—uj,k). Equation 
(JHJ can be used to obtain a condition which relates the values of $^(cu, k) in the two points 
of the complex plane [22] 

$*(-u*,k) = $%(u,k). (11) 



The same equation can be written for and, consequently, for operators in Eqs. ©-©• 
Henceforth only the retarded operators are used and index R is omitted. 

We write the expression for <&n(u), k) in such a way that it does not contain the overlap- 
ping logarithm cuts (compare with I27|): 

ml f—ujm + kpp ( \ 

M">*) = [ 2 " mln { ujm-kp F + \k 2 ) (12) 

(kp F ) 2 — (um — \k 2 ) 2 ( um — kp F — \k 2 \\ 
+ 2k 2 11 [urn - kp F + Ik 2 ) ) 

for < k < 2p F . Each of logarithms has its own region of integration over p and over the 
angle between p and k in (JHJ) . These regions are shown in j2Zj . 

At k > 2p F , (f) N (uj, k) is the Migdal's function [T1 l2T] 

,3 



; / r \ 1 rrr 




(13) 



where a = uj — (k 2 /2m), b = kp F /m. 

Function $>&(u,k) = (f>A(u,k) + (f>&(—uj,k), where (j)^(u,k) is determined by (fT3|) with 
a = a; — (k 2 /2m) + (wa — m). 

Let us consider the cuts of H° n (uj, k) in the complex plane of u>. It is clear that, for 
k < 2p F , there are two cuts (we denote them by / and II). The cuts originated by the 
logarithmic terms of (|12j) are at 

I:0<u;<^-^- (14) 
m 2m 

kp F k 2 kp F k 2 

II : < uj < 1 . 

m 2m m 2m 

The cuts of the function 4>n{— k) lie on the negative semi-axis symmetrically with respect 
to the cuts in (JUJ). Therefore, H%(uj, k) has four cuts in the complex plane of u, which are 
shown in Fig. 2. When uj > 0, the cuts are caused by the singularities of 4>n{w, k), while at 
u < the cuts are related to the logarithms of 4>n(— oj, k). 

The imaginary factors in denominators in Q determine the physical sheet in the complex 
plane of frequency. On the physical sheet the first logarithm in (J12j) has the imaginary part 
on the upper edge of the cut / equal to — rri, and +7ri on the lower edge of the cut. In the 
point urn — kpp + ^k 2 =0, where the cuts / and II touch each other, the imaginary part of 
4>n{w, k) is continuous but there is a jump of the derivative. This is shown in [23, Fig- 12.9. 

Let us now determine the unphysical sheets which we pass on when go under the cuts 
/ and I' (Fig. 2). Consider the cut /. We denote the first logarithm in (|T2"|) as ln(zi) 

In ^ m _^ + i fc2 ) • While the frequency uj goes along the cut / (jHj) : uj = (0, ^ — Jj^) then z\ 

is changed in the interval Z\ = (0, — oo). The cut I in the complex plane of uj corresponds to 
the cut along the negative real axis in the complex plane of z\. When we go to the cut I from 
above (the arrow in Fig. 2a), this corresponds that we go to the cut from below in the complex 
plane of Z\. Going over under the cut, we pass on to the unphysical sheet neighboring with 
the physical one on the Riemann surface of ln{z\). The values of ln{z\) on the neighboring 



sheet differ by of (— 2iri) from the values on the physical one at the same uj. As example, 



the value of In 



on the lower edge of cut I is In 



Ljm— kpp + \k 2 

value at the same point of uj on the unphysical sheet is In 



-kpp+ik 2 



ojm—kpp + ^k 2 



+ Tci. But the 
— ixi. Thus, we 



have the continuous changing of logarithm along the arrow in Fig. 2a. Then we conclude 
that H(u,k) in Eq. (0) changes continuously as well. Thus, going over under the cut / in 
Fig. 2a we pass on to the unphysical sheet of the complex plane of to that is placed under 
the physical sheet. Let us denote the unphysical sheet with the same letter as a cut: /. The 
part of the unphysical sheet / is shown in Fig. 2b by the shading with the right slope. 

Now we define an unphysical sheet related to the cut I' (denote the sheet by /'). The cut 

I' stems from the first logarithm in 0(— uj, k). We designate ln(z[) = —In (^ _ ujm ~^ + i k2 

^ n { ^ m+k ^m ^ )• Going over under the cut of ln(z[) we add the shift — 2iri to the value of 

ln(z[). Then, the logarithm on the sheet /' under the lower edge of the cut /' is equal to 

In (- " m+k ™-* k2 \ +7ri- 2™. This expression is used for the analytical continuation to the 

sheet I'. The part of the sheet I' is shown on the Fig. 2b by the shading with the left slope. 

In the paper we consider the solutions of ((TJ) which are placed on the shaded parts of 
the unphysical sheets I and I' in Fig. 2b. Each logarithmic term in (flT)|) . (jl2)l has its own 
Riemann surface. An important point here is that moving on Riemann surface of one of 
logarithms we stand on the physical sheet for the other logarithms. 

Thus, we have built up two unphysical sheets I and I'. Let us show that the values of 
U° n (uj, k) are real and coincide on the negative imaginary axes of the sheets / and V . 

On the imaginary axis we denote uj = iuji. On the negative imaginary axis of the sheet 
/, the function <& N ffTU|) . (fT^ takes a form 



§ N (iuj h k) 



4^ 



1-^ In. 



kpi 



-lujjm 



iuj;m 



kp F + \k 2 



7T2 



(15) 



iujim (. iujim + kpp 

1 In 



1 7„2> 



kpi 



lujjm 



+ 



mpp 



1 + 2- I arctg- 



ujivn 




(16) 



kpp \ ^ kp F — |/c 2 2 
Here only the first and the second terms of 4>(uj, k) and 0(— uj, k) ()12j) are shown. 

On the other hand, on the negative imaginary axis of the sheets /' the function $at (|1()|) 



is 



® N (iUi,k) 



mpp 



kpi 




iujim , 
1 - —5— In 



iujim 



i.jj,iii /, iujim + kp F — \k 2 



kpp iujim — kpp + \k 2 
- ni) + . 



(17) 



—iuj~m 



and after reduction we have the expression (|T6*|) again. This is the illustration of the following 
connection between the values of VP n {uj, k) on / and /' sheets: 



Thus, IIjy-(u;, k) is defined on the lower semiplanes of the unphysical sheets I and I' (the 
shaded regions in Fig. 2b), and the values of U° N (uj,k) coincide on the negative imaginary 
axes of the sheets I and The special solutions of (1) which we are interested in, are placed 
on the shaded part of the complex plane of uo in Fig. 2b and on the imaginary axes of the 
physical and unphysical sheets. 



3 Investigation of instability at G' NN < G' tr 

In this part we consider solutions of the pion dispersion equation (1) at G' NN < G' tr . The 
definition of G' tr will be given in the Sect. 5, since it is determined by the behavior of branches 
which are studied in Sects. 3,4. We start by considering the zero-sound dispersion equation, 
and investigate its solutions for different values of G' NN . We demonstrate the modification 
of these solutions when we pass to the pion dispersion equation. 



3.1 Zero-sound dispersion equation 

In this Subsection we consider the unstable solutions u s d(k) of the zero-sound dispersion 
equation. For G' NN < — 1, they are amplified, placed on the physical sheet and reflect the 
instability of nuclear matter in respect to the small fluctuations of density. For —1 < G' < 0, 
the branches u s d(k) are damped, and come to the negative imaginary axes (which belongs 
to the unphysical sheets I and I'). 

In this Section we do not take into account the excitations of isobar and restrict ourselves 
by U(uj,k) = Up(uj,k) in (JHJ). The zero-sound dispersion equation stems from (jHJ) and has 
the form 

-4Co$*r(w,A;) = ^. ( 19 ) 

The results obtained for this equation are valid both in spin-isospin and in isoscalar, spin, 
isoscalar channels. 

First we obtain the solutions of Eq. (jl9j) in the kinetic theory of Landau and compare 
them with the known results. The function $>n(uj, k) (|1UI12|) in the long wavelenths limit is 

Substituting this expression in we obtain the known zero-sound dispersion equation 

1 + 1 = ( + = £ l n £±I (21) 

G 2kpp \umi — kpp J 2 s — 1 

Here we denote s = When G' < —1, this equation has two (positive and negative) 

solutions on the imaginary axis of the physical sheet [221 121] • Let us denote s = ij, then 
Eq. (J21j) transforms into 

1 + ^=7 arctg- . (22) 

To obtain solutions for — 1 < G' < 0, we take the long wavelength limit of Eq. and 
substitute it in (fTUj) . On the negative imaginary axis of the unphysical sheet, we get an 



equation 



1 



7T 



(23) 




2 



Solutions of this equation are negative, i.e., 7 < 0. This equation coincides with that 
presented in paper [19|. It was pointed out in [TO] that the solution of Eq. " do not 
correspond to an actual solution" . In agreement with this statement we see that solutions of 
(|23|) are located on the negative imaginary axis belonging both / and I' unphysical sheets. 
It was explained in JO] the damping of this mode is the Landau damping [2*2*] . 

In Fig. 3 the solutions 7 to Eq. (JT§j) are shown at G' < 0. They are similar to the 
solutions at G' < in Fig. 1 of [TH] (except the curve ab at — 1 < G' < 0). The shaded 
region means that the solution are on the unphysical sheets. In Fig. 3 it is demonstrated 
that when the attraction between the particles is increasing, the damping solution placed on 
the unphysical sheet goes over to the physical sheet, turning to amplified solution. 

Considering the unphysical sheets we can find two solutions of (fTT^) for any value of G 1 < 
(Fig. 3). However, at — 1 < G' < they are on the different unphysical sheets. It was shown 
that the solutions of Eq. (j2Hj) are negative thus being located on the unphysical sheet /. Now 
we look for solutions with 7 > (curve ab in Fig. 3). The situation is the same as we had 
with the sheets I and I'. There are two new unphysical sheets / and I' which overlay the 
physical one. In Appendix B the construction of these sheets is presented. The dispersion 
equation (|19|) on the imaginary positive unphysical axis is the same on the both / and P 
sheets and has a form 



The solutions of this equation are positive. This equation turns into Eq. ()23|) if to change 
the sign of 7. The solutions of this equation are shown by the curve ab in Fig. 3. They are 
located on the positive imaginary unphysical axis (this is marked by the horizontal shading). 

Let us compare Fig. 3 and Fig. 1 in (201 • I n P a P er [20] only one curve is presented which 
corresponds to decreasing of 7 with increasing of G'. This curve describes the physical 
processes: the amplifying of the amplitudes of the small fluctuations at G' < — 1 and the 
Landau damping of excitations at — 1 < G' < 0. According to PjJ 120] in the spin-isospin 
channel this curve can be considered as describing the 7r + -type excitations. Another curve 
shown in Fig. 3 corresponds to the 7r~-type excitations. Their frequencies are to be taken 
with the opposite sign in respect to the ones shown in Fig. 3. There are two solutions for 
7r°-type excitations. One of them corresponds to the growing excitations (at G' < — 1) and 
the second should be taken with the opposite sign and becomes to degenerate with the first 
one in the symmetric and asymmetric matter. 

It is well known that the kinetic theory of Landau gives the linear dependence of fre- 
quencies of collective excitations on the wave vectors, i.e., uo ~ k. When we pass to RPA 
using Eqs. (fT0|) . (fl"2j) . the shape of the dependence changes and we obtain the branches of 
solutions Ui(k). In Fig. 4 we show the imaginary branches u) s d{k) obtained in RPA. The 
shaded fields on the edges of figures indicate that the branches are located on the unphysical 
imaginary axis. We see that the branches change continuously with G' . When — 1 < G' < 0, 
the branches uj s d{k) are located on the unphysical sheet only, but for G' < —1 they go over 
to the physical sheet in the interval of wave vectors k — (0, kf in ). 

In analogy with Fig. 3, we can find the second solution of Eq. for each values of G' 




j(arctg(j) + -). 



(24) 



and k. The "symmetric" branch has the conjugated values on the physical sheet u* d (k), but 
it goes to the unphysical sheet / when k > kf in . 

All solutions belong to the same family uo sd . This family exists at G' < 0. 
3.2 Pion dispersion equation 

We consider the influence of the pion-nucleon interaction on the branches uj s d{k). Following 
we include only the direct term of the interaction of the pion with a particle-hole pair, 
and do not take into account the noncentral interaction of the quasiparticles. In this Section 
we take into account the isobar- hole pairs contribution to the pion self-energy, Eq. (JB|). 

First let us investigate how the contribution of isobar-hole excitations changes the sta- 
bility conditions. Let us assume in Eq. (|19|) that u=0 and k — > 0. In this limit this equation 
reduces to — 1 = t^— • This gives the value of G' NN when instability occurs in the long 
wavelength limit. If we take into account the isobar-hole loops, this condition takes the form 

. n , , _ _ , , l + Cof$ A (0,k)G'l A 

46 ° N[UJ " °' k) W G' NN (1 + C f $a(0, k)G' AA ) - C f $a(0, k)G'* NA " (25) 

At u=0 and k — > 0, $a(0, k) is proportional to nuclear density: $a(0, k) ~ 2{m&-m) • ^ 
p — > 0, the corrections produced by $a disappear. As a result the values of p c and k c on the 
solid lines in Fig. 1 approach the dashed ones. In Fig. 1 the solid lines are obtained for the 
minimal densities when solutions with u=0 emerge for every G' NN . 

It is shown in Fig. 5a, how oj^ d {k) are modified when f^NN is changed from to 1. 
At f n NN=Q the branch of solutions of the zero-sound dispersion equation, Eq. (JHJ), oj s d{k) 
is presented. (It should be noted that the results in Fig. 5a are obtained for Il A {<jj,k) 
contribution being included in pion self-energy Q while those in Fig. 4 do not include 
I1a(^, k).) As we see from Fig. 5a, the growth of f^NN results in emerging of the amplified 
solutions on the physical sheet at — 1 < G' NN < G' tr . 

In Fig. 5b the branches u:1 d {k) are shown for different values of density of nuclear matter. 
The curve 3 is calculated for p = p c and contains the point u!^ d (k c )=0. It is demonstrated 
how the zero value u;=0 is placed on this branch (the point A). At the point A the condition 
( ^dk^ ) k k = ^ S satisfied- The density p c and wave vector k c , corresponding to zero solution, 
are presented in Fig. 1 (denoted by A). When density is lower than the critical one, ujg d (k) 
are completely situated on the unphysical sheet (curve 4) and the nuclear matter is stable. 
When p > p c , the amplified solutions appear on the physical sheet in the certain interval of 
k (the curves 1 and 2). 

Figures 5a, b demonstrate the typical behavior of the branches of solutions of (1) at 
G' NN < G' tr . Thus, we obtain the instability of nuclear matter related to uj^ d {k) for all 
G' NN < G' tr . Instability occurs at p > p c . The corresponded solutions of the zero-sound 
dispersion equation, u s d(k), demonstrate instability at G' NN < — 1 only. 

We refer uJg d (k) to u s d family. 



4 Investigation of instability at G' NN > G' t 



Now let us consider in Fig. 1 another well studied region G' NN ~ 2. This region of G' NN was 
investigated in connection with prediction of the pion condensation. 

In Fig. 6 the solutions of Eq. (1) are presented at G' NN = 2 and -^=1.78. Such figures 
were published in papers pQ. In Fig. 6 we see the pion branch of solutions u n (k), it starts 
at the frequency aj7r ^~°^ = 1. It turns into the free pion solution as f n NN —> 0. The isobar 
branch u^(k) starts at the frequency which is determined by the isobar and nucleon mass 
difference. The zero-sound branch u*(k) starts at ui s (k = 0)=0, and at certain value of k it 
acquires an imaginary part due to Landau damping |2"2"] . It goes over to unphysical sheet 
related to the cut II, Eq. (JT3J), E]. Besides the numerated branches, one more imaginary 
branch is presented in Fig. 6. Let us denote it u c (k). Tracing of this branch of solutions 
stimulated development of the theory of the "pion condensation" pQ. 

In this Section we investigate the family of solutions uj c and show that this family is 
responsible for the instability at G' NN > G' tr . In Fig. 6 a part of a branch u c {k) is presented 
that is located on the physical sheet in the interval k\ < k < k 2 . The rest of this branch is 
on the unphysical sheet /. 

In Fig. 7 we present the same branch u c {k) as in Fig. 6, but here we show it from another 
point of view, i.e., considering the complex plane of uo (the solid line). The branch u c (k) 
starts at k=0 at the point '1' and has the real value a;c ^~°' ) = 1. With the increasing of 
k it moves to the unphysical sheet /. It follows from (j!8|) that there is another branch of 
solutions uj' c (k), which starts at the point " e( - fc ~ ' ) = —1 and is placed on the unphysical sheet 
I' (the dashed curve). 

Below in paper, the hatching on the edge of figures with the right slope means that the 
drawing branches are located on the unphysical sheet /. The left slope means that they are 
on the sheet I'. The physical sheet is above the axis of abscissas. 

In point '2' u c (k) and cu' c (k) coalesce on the imaginary axis. Then u c (k) ascends the 
imaginary axis and w' c (k) descends. (To determine which of branches go up we can take into 
account the width of isobar in Eq. (jSJ) as in [2 .) Thus, two simple roots of Eq. (1) which 
move on the unphysical sheets / and I' (when k increase) coalesce on the imaginary axis 
at k = k m . Here the roots become imaginary ones, and continue to move up and down the 
imaginary axis which belongs to both I and I' sheets. 

In Fig. 7 the values of u c (k) and u' c (k) are shifted from the imaginary axis by hand to 
demonstrate the trajectories of solutions with increasing of k (it is shown by arrows). The 
wave vector k = k t corresponds to the turning point of the trajectories '3'. At this point, 
u> c {k) and u)' c (k) reach their maximal and minimal values. When k > k t , the branches return 
along the imaginary axis. In Fig. 7 the solutions are presented for k < 2Ahm n . At larger k, 
the behavior of branches has a nontrivial character but it is not related to physical processes 
and is not discussed here. In Figs. 6, 7 it is shown how 1) the branch u c (k) goes from the 
unphysical to the physical sheet at k — ki; 2) it becomes imaginary, with growing value 
of Im(uj c (k)) > 0, on the physical sheet; 3) the branch returns to the unphysical sheet at 
k = k 2 . 

In Fig. 8 the complex plane of uj is presented where u c (k) and u)' c (k) are shown for different 
densities of nuclear matter. In these figures (except Fig. 8a), the branches are drawn up to 



the turning point on the imaginary axis, i.e., at k = {0,k t ) (see Fig. 7). In Fig. 8a the 
density is small and the branches do not attain the imaginary axis. In Fig. 8b the branches 
encounter on the imaginary axis but completely stay on the unphysical sheets (kt = 1.7877^). 
In Fig. 8c the result for the critical density p c is presented. On the real axis the solution 
with u=0 appears. Here k t = k c (k t = 1.81m,,-) and we see that the conditions u c (k c )=0 and 
\ dk J = ^ are swished- The wave vector and density corresponding to the point B in 
Fig. 8c are marked by B in Fig. 1. In Fig. 8d it is demonstrated that at p > p c the solutions 
with Im(uj c (k)) > (k t = 1.88m w ) exist on the physical sheet. 

The critical densities and wave vectors in Fig. 1 for G' NN > G' tr correspond to the 
solutions denoted by B in Fig. 8c. Such solutions u) c {k) can be found not only when G' NN > 
G' tr , but for G' NN < G' tr also. It should be mentioned, that an attempt to shift the pion 
condensation to larger densities means that u c (k) go on to stay on the unphysical sheet at 
larger densities. There are several reasons that can influence our results. It was shown in 
[2] that the important factor shifting the pion condensation to the larger densities is the 
decreasing of the effective nucleon mass with growth of density. This decreasing is predicted 
by the scaling of Brown- Rho [3U] and QCD sum rules However, at smaller values 

2 

of the nucleon mass the lowest order expansion in powers of j— in Eq. Q is not valid any 
more, thus requiring relativistic kinematics for the nucleon. Besides, the formation of isobar 
Fermi surface must be taken into account, as soon as the density becomes so large that the 
quasiparticle energy on the Fermi surface exceeds the difference of the isobar and nucleon 
mass. 

In Figs. 7, 8 the branches u c (k) start at the point u> c (k = 0) = m^. Inclusion of the scalar 
part of the pion self-energy lis, Eq. (J2J), displaces the initial value to w^(k = 0) = + Us 
(Appendix A). However, this does not modify the curves in Fig. 1 qualitatively. 



5 Determinat ion of Gf r 

In Sects. 3, 4 we have presented zero-frequency solutions of Eq. (1), which appeared for 
different values of G' . In this Section the "transitional" value G' tr is obtained. In Sects. 3,4 
it was shown that at G' NN < G' tr the zero-frequency solutions belong to the family u s d and 
at G' NN > G' tT they refer to uj c . In this Section the transition of solution with u=0 from one 
family to another is demonstrated. 

In the vicinity of G' tr , at G' NN ~ G' tr , the branches belonging to Ug d and uj c families are 
placed close to each other on the same unphysical sheets. In Figs. 5, 7, 8 these branches are 
shown separately. In Fig. 9 the branches of the both families are shown simultaneously. 

In Fig. 9a at G' NN = —0.0020 and p = p c , the branches u c (k), u)' c {k) and oj^ d {k) are 
presented simultaneously. The critical value of the wave vector is k c = 1.61m^. The branches 
ui c {k) and uj' c {k) behave like in Fig. 8a. The branch oj^ d {k) is shown by the dotted curve and 
it is presented in the interval k = (0, k c ). The behavior of u>g d (k) is similar to the curve 3 in 
Fig. 5b between k=0 and the point A, which corresponds to k = k c . 

In Fig. 9a number '1' denotes the start of branches at k=0; '2' means the turning point 
of u^ d (k): £^=0.077777^; '3' corresponds to /c=0.1m^-. We see that uj^ d (k) descends when k 
changes from '0' to k t and then ascends and turns to zero at k = k c : u^ d (k = k c )=0 (point 
C in Fig. 1). 



Now let us enlarge a little the coupling constant: G' NN =-0.0018. The following calcula- 
tions are made at the critical density p = p c , corresponding to this value of G' NN . In this 
case we have a coalescence of u c (k) and u)' c (k) on the imaginary axis. The wave vector of 
coalescence is equal to k m =0.0962m 7T . In this difficult for drawing case, the presentation of 
the branches is made in two steps. In Fig. 9b the branches are shown at k < 0.09477^, i.e., 
before coalescence and in Fig. 9c at k > 0.09477^. The position of branches at /c=0.094m„- 
are marked by '2'. 

In Fig. 9b it is shown that the position oiujg d (k) at point '2' is much lower on the negative 
imaginary axis than the Imu> c (k) and Imu' c (k). Further, in Fig. 9c we see the coalescence of 
ui c {k) and oj' c {k) at k = k m (point '3'). Then u c (k) and u' c (k) go in the opposite directions 
along the imaginary axis. 

In Fig. 9c it is shown that the branch w' c (k) descends and meets the branch uJ^ d (k) in the 
point '4' (at k m —0-i09m n ). [The branch uj^ d (k) has turned upward at k=0.104m n .} After the 
second coalescence, the branches oj' c {k) and ou^ d (k) go in the opposite sides on the complex 
plane. Thus, the branch u' c (k) has blocked uj^ d {k) on the unphysical sheet. 

The branch u c (k) goes over to the real axis and a solution with u=0 (point D) belongs 
to this branch: u) c (k c )=0 at k c =1.60m n (the point D in Fig. 1). 

Thus, the value of G' tr is determined by the interaction of branches on the unphysical 
sheets shown in Fig. 9. We can conclude that G' tr is a special value of the spin-isospin effective 
quasiparticle interaction when 1) there is coalescence of uj c (k) and oj'JJz) on the imaginary 
axis at the critical density p = p c and 2) Imuj1 d (k m ) < Imuj c {k m ), Imuj' c (k m ). The second 
condition is satisfied as a rule, since Imw^ d {k m ) tends to — oo as G' — ► —0 (compare with 
Fig. 3). 

In Fig. 9 the results are presented for H(cu, k) = IIjv(u;, k) (J2J), i.e., without the excitation 
of isobars. In this case we have obtained G£ r =-0.0019. If to solve Eq. (1) with Hp(u, k) = 
IIzv(u;, k) + Ha(^, k), then G^ r =0.0020. The influence of S'-wave pion-nucleon interaction is 
discussed in Appendix A. 

It is interesting to mention that the figure similar to Fig. 9 is presented in |2Hj for the 
solutions of the zero-sound dispersion equation. Their figure demonstrates the behavior of 
solutions for the different values of F and the branches of solutions depend on Fi instead of 
k (this means the dependence on the value of the quasiparticle effective mass m* along the 
branch). In paper [SHj F and Fi are the zero and the first multipolar components of the 
scalar-isoscalar effective interaction of the quasiparticles. 

6 Discussion 

A. In this paper two families of solutions to the pion dispersion equation are calculated, which 
determine the stability boundary of the nuclear matter (the critical density p c ) depending 
on the value of spin-isospin coupling constant G'. It is shown that there is a special value of 
G' = G' tr such that for G' < G' tr the stability boundary are related to the family Ug d and for 
G' > G' tr it refers to uj c . 

It is interesting to investigate, whether we can obtain the information about the difference 
of the phase transitions at G' < G' tr and G' > G' tr using the branches of solutions. To do 
this let us consider the rate of growth of excitations in the vicinity of G' tr . For p > p c , 



Eq. (1) has solutions with Imu>i(k) > 0. In Figs. 5, 7, 8d such solutions are presented. We 
determine T(k) = —iu>i(k), i = sd,c. We can take several values of G' close to G' tr and 
calculate the maximal values of T{k) (i.e., T(k t )) depending on p for the every G'. In Fig. 10 
these results are demonstrated for G' = G' tr , G' tr ±0.02, G' tr ±0.2, where G' tr =-0.0019. In this 
figure we cannot observe the essential difference in the dependence of T(k t ) on p for G 1 < G' tr 
and G' > G' tr . It is possible to conclude that either this test is not sensitive to the type of 
excitations, or the character of the phase transition changes continuously with G' from long 
wavelength instability up to the pion condensation. 

B. Now let us consider the singularity of the integrals containing the pion propagator D 
(1): F = J D(u, k)f(u, k)dujd 3 k, in the poles of D(u,k) when p = p c and k —>■ k c . The 
function f(u,k) is not related to the poles of D(u,k). In the Sect. 3.1 for the zero-sound 
dispersion equation (|SJ), it was shown that there are two solutions on the physical sheet. At 
— 1 < G' < 0, the amplified solutions go over to the unphysical sheets /, V and the second 
branch goes over to the unphysical sheets /, /' (Fig. 3). 

Similar situation takes place for the pion dispersion equation. Up to now we considered 
the solutions which are located on the physical and unphysical / and V sheets, but there 
are the "symmetrical" solutions. They have the conjugated values on the physical sheet and 
their unphysical sheets are / and V . This means that at p = p c and k = k c not only u)i(k c )=0 
(i = sd, c) but the "symmetrical" branch as well. As a result, the function F has a form (we 
leave the singular part only) 

dud^k 

;f(u = 0,k e ). 



{u»-u$(k)¥ 



Since we are interested in such zero solutions that ( ^J; ) =0, then Ui = a(k — k c ) 2 as 

\ aK J k=k c 

k —>■ k c and the integral diverges along the curves in Fig. 1. This correspond to situation of 
the phase transitions 



C. In the paper we do not consider the case when G' NA , G' AA are modified simultaneously 
with G' NN . But as it is shown above, the existence of G' tr and u> c (k), u) s d{k) does not depend 
on whether we take excitation of the isobar into account or not. Therefore we do not expect 
the qualitative changes in our results if we change the values of G' NA and G' AA together with 



G' NN . 



7 Conclusion 

In the paper we investigate of the zero-frequency solutions of the pion dispersion equation 
depending on the values of the spin-isospin coupling constant of quasiparticles G' . For every 
G", the critical density p c and the wave vector k c corresponding to the solution with u=0 were 
calculated. Then the branches of solutions, containing these zero solutions, are constructed 
and it is determined to what type of excitations (to what family) these solutions referred. 

It is shown that the zero-frequency solutions belong to the different types of excitations, 
depending the value of G' . In all models used in calculations, the "transitional" value G' tr 
{\G' tr \ <C 1) is found, such that at G' = G' tr the zero solution passes from the branches of the 
type uj S (i to the ones of type u> c . 

At G' < G' tr , the unstable amplified branches of solutions for the zero-sound dispersion 



equation (uj sd (k)) and for the pion dispersion equation (u;J d (/c)) are constructed (Figs. 3, 4, 5). 
In Fig. 5a we see that if to take the pion-nucleon coupling constant f n NN value to be very 
small, oj sd {k) and 0J^ d {k) are very close. When we increase f n NN up to 1, the behavior of 
ujg d (k) is change: the damping solutions become amplified ones (Fig. 5). We obtain that the 
zero-frequency solutions of Eq. (1) at G' < G' tr belong to the same family of solutions which 
is responsible for the long wavelength instability in the kinetic theory of Landau. 

Figure 1 demonstrates that the stability boundary continuously extends to G' > G' tr . 
But at these G' the unstable solutions belong to family uj c . It is shown that this family 
contents the solutions responsible for the pion condensation. 

It is possible to expect that a new state of medium after phase transition is different 
depending the value of G' . We investigated the dependence of the maximal growth rate of 
perturbations at several G' in the vicinity of G' tr on density. But this dependence does not 
exhibit the noticeable modifications at G' tr . 

Author thanks S. V. Tolokonnikov for the constructive criticism. Also, author thanks 
V. R. Shaginian and E. G. Drukarev and especially M. G. Ryskin for the numerical fruitful 
discussions. The work was supported by the grants RFBR-03-02-17724. 



8 Appendix A. 

In this appendix the scalar part of the pion self-energy, lis, (2) and its influence on the 
behavior of the curves in Fig. 1 are considered. We construct lis using the relation of Gell- 
Mann-Oakes-Renner [SB]- It permits to express the pion mass in medium through the 
quark condensates in nuclear matter 



,3 (NM\qq\NM)(m u + m d ) 



where m u ,m d - masses of u- and <i-quarks {m u + m d =ll MeV), /* - coupling constant of 
the pion decay in the medium (here we assume that /* = f 7T =92 MeV, i.e., the vacuum and 
medium values of f n coincide). The value k = (NM\qq\NM) is a scalar quark condensate 
in nuclear matter. It may be present as 

K = k + p(N\qq\N) + ... (A2) 

Here kq is a scalar quark condensate in vacuum, kq=- 0.03 GeV 3 ; (N\qq\N) is the matrix 
element of the scalar quark condensate calculated over the nucleon (N\qq\N) ~ 8. Then 
from (Al) we obtain 

* 2 2 {N\qq\N){m u + m d ) 

m n = m n ~ P y- 2 ■ (^3) 

On the other hand, we can define m* 2 using Eq. (1) as 

mf = ml + n(w, k = 0) . (AA) 

The form of lis can be obtained comparing (A2) and (A3) provided that IIp(a;, k = 0) = 

(N\qq\N)(m u + m d ) 
n 5 = ~P 7TT 2 • \ Ah ) 



In Fig. 1 the dotted lines correspond to the critical density p c and wave vector k c ob- 
tained for Eq. (1) with the pion self-energy (J2J). (Recall that for each G' in Fig. 1 we show 
the minimal p c when solution u=0 appears). In this model the transition value of G' is 



(4=0.0026. 



9 Appendix B 

Here we construct the unphysical sheets I and I'. The solutions of Eq. (19) that are presented 
by the curve ab in Fig. 2 are placed on these sheets. 



To pass on to the sheet I we do the analytical continuation in oj of ln(z) = In ( ^ m _^ m + i fc 2 
from the lower edge of the cut I upwards, adding 27ri to ln(z). The sheet / is situated above 



the physical sheet. The value of In y ujm _^ + i k2 j above the upper edge of the cut / is 
ln(—z) — iri + lui. This expression is continued on the sheet /. 

In similar way we construct the sheet V making the analytical continuation of In(z') = 
In ( uim+kpF — 2M from the lower edge of cut adding 2ni to logarithm values. 
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10 Figure captions 



FIG. 1. Critical values of nuclear density p c and wave vector k c , at which in Eq. (1) solutions 
u;=0 appear. Results for three models of the pion self-energy are presented: solid lines 
correspond IT = Iljv + IT a = lip (j2j), (JHJ); dashed curves are for II = II jv; dotted curves are 
for the total II = n P + U s ©• 

FIG. 2. Complex plane of the frequency to. a) Numbers / and 77 denote the cuts (jl4j) of 
4>{uj, k) and V and IF denote the cuts of <fi(—uj, k); b) Unphysical sheets are shown: sheet / 
(the shading with the right slope) and sheet I' (the shading with the left slope). 

FIG. 3. Solutions of Eqs. (J22J, (J2SJ) , fl2H) at G" < in the kinetic theory of Landau. The 
shading with the left slope marks unphysical sheet / and the horizontal shading refers to /. 
Results are obtained at p = p . 

FIG. 4. Imaginary solutions uj s d{k) to Eq. (|19|) obtained in RPA for following values of G'\ 
(1) -0.4; (2) -0.9; (3) -1.02; (4) -1.1; (5) -1.2. Results are obtained at p = p . 

FIG. 5. Imaginary solutions u) s d{k) of Eq. (|HJ). a) Dependence of 0J s d{k) on f^NN' the curve 
(1) firNN=0', (2) 0.4; (3) 0.6; (4) 1.0. The results are obtained at p = po and G' NN =-0A. 
b) Dependence of uj s d(k) on the value of density: the curve (1) p/po=l; (2) 0.318; (3) 0.265; 

(4) 0.221. The results are obtained at f n NN=^ and G' NN =-0A. Point A marks solution with 
lu=0. 

FIG. 6. Different types of solutions of Eq. (1): spin-isospin zero-sound branch cuj(fc), pion 
branch u n (k), isobar branch uo^{k) and condensate branch uj c (k). Results are obtained at 
^=1.78 and G' NN =2. We computed that ^=1.35171^, fc 2 =2.35m 7r . 

FIG. 7. Branches u> c (k) and uj' c (k) on the complex plane of frequency. The shading with the 
right (left) slope marks the unphysical sheet I (/'). The physical sheet is above the abscissas 
axis. Axes of reference are shown by the dotted lines. The solid curve correspond to u> c (k) 
and the dashed one is for uj' c (k). The number '1' marks start of branches at k=0; '2' is the 
coalescence point at /c m =1.28m 7r ; '3' is the turning point at k t = 1.88m n . Variables ki, k 2 , 
and G' NN are the same as in Fig. 6. 

FIG. 8. Branches u c (k) and uj' c (k) on the complex plane of frequency at different densities ^. 
In figures b,c,d branches are shown at k < k t . Point B marks solution with u=0. Notations 
of lines and sheets are the same as in Figs. 6, 7. 

FIG. 9. Transition of a zero solution from family u s d to family u c . The solid, dashed and 
dotted curves denote u> c (k), u)' c {k) and ujg d (k), correspondingly, a) G'=-0.0020. The number 
'1' corresponds to k=0; '2' means turning point of u>g d (k): k t =0.077m n ; '3' /^O.lm,,-. Arrows 
show movement of branches with k. Point C corresponds to uj^ d (k c )=0. b) G'=-0.0018. 
Branches are shown for k < 0.0947727,- (point '2'). c) Continuation of figure b. Branches 
are shown for k > 0.094777.^. Point '3' marks the coalescence point of u) c (k) and u>' c (k) at 
fc=0.0962m 7r . Point '4' shows the coalescence point of uj' c {k) and oo^ d (k) at ^=0.109771^. Point 
D corresponds to uj c (k c )=0. 

FIG. 10. Dependence of the maximal growth rate of fluctuations on density. The curve (1) 
corresponds to G' = G' tr =-0.0019; (2) G' = G^-0.02; (3) G' = G^+0.02; (4) G' = G' tr -0.2; 

(5) G' = G' tr +0.2. 
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